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ABSTRACT 

The oblectives of this study were: (1) to determine 

if a student’s attitude toward his role as a rater of teacher 
behavior could be changed to become more positive as a result of his 
orientation to that role; (2) to determine if the choice of the 
student to continue to rate could be influenced; and (?) to determine 
if the inter-rate variability could be reduced and a more uniform 
frame of reference developed. An attitude scale concerning the role 
of students as raters of teacher behavior was developed and 
administered to two equal qrouDS, randomly drawn from the Fall 1969 
freshman class at Freed-Hardoma n College. Three qroup counselina 
sessions were held to exolain the purpose of rating, importance of 
student opinions efforts being made by the faculty to improve 
instruction, use of the data collected an* possible benefits to 
students which could occur as a result of their participation as 
raters. Findings indicated that the orientation did not sionif icantly 
affect the student's attitude toward his role as a rater, nor his 
decision to continue as a rater. Th« control aroup was predominantly 
disposed toward ratino, and hence there was no significant difference 
between the two groups on the choice of rating. (Author/A r ) 
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SUMMARY 



This project was undertaken (1) to determine if a student's attitude 
toward his role as a rater of teacher behavior could he changed to be- 
come more positive as a result of his orientation to that role, (2) to 
determine if the choice of the student to continue to rate could be in- 
fluenced, and (3) to determine if the Inter-rater variability could be 
reduced and a more uniform frame of reference developed. 

The hypotheses tested were: 

1. There is no significant difference In the attitudes 
of students receiving an orientation treatment to 
their role as raters of teacher behavior and the 
attitude of the control group. 

2. There is nc significant difference in the choices 
of students receiving an orientation treatment to 
continue to participate as a rater and the choices 
of the control group. 

3. There is no significant difference in the variance 
of students receiving an orientation treatment and 
the variance of the control group. 

An attitude scale concerning the role of students as raters of 
teacher behavior was developed and administered to two equal groups, 
N«50, which were randomly drawn from the freshman class at Freed- 
Hardeman College in the fall of 1969. 

An orientation treatment was developed and administered to the ex- 
perimental group. Three group counseling sessions were held to explain 
(1) the puipotes of rating, (2) the Importance of student opinions, 

(3) the efforts being made by the faculty to Improve instruction, (4) 
the use to be made of the data collected, and (5) the possible benefits 
to students which could occur as a result of their participation as 
raters. 

The analysis of data did not reveal a sufficient basis to reject 
the hypotheses. The control group was predominantly disposed toward 
rating and hence, no significant difference was observed between the 
two groups on the choice of rating. Although (he change in attitude of 
the experimental group was not sufficiently large to be algni t leant some 
changes in a positive direction were noted. 
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PART I 



Background and Significance 



I . Review of Literature 

Part of the difficulty associated with the measurement of 
teacher effectiveness arises because of the variations in per- 
ception of those who rate. Kerllnger (1963) demonstrated the 
importance of the central directive state of the individual when 
making judgments concerning teacher effectiveness. He concluded 
that attitudes are an Important part of the complex of psycholo- 
gical factors that Influence judgments concerning teacher 
effectiveness. 

Gage (1963) reported his optimism concerning the potential 
effect of student feedback as an effective way of changing teacher 
behavior. He found that feedback not only produced change in 
behavior, but altto produced corresponding changes in the accuracy 
of teacher perceptions of their pupils' perceptions of them. 

The validity of student rating of instructors was studied by 
Hudelson (1951). Using e scattergram of instructor's marks and 
students' ratings a coefficient of correlation was computed. He 
concluded tnat the relationship was not sufficiently large to 
conclude that students were allowing marks to influence their 
rating of teachers. 

Remmer8 (1*763) made the observation that bias may arise from 
the student's general liking or disliking of the rating object. 
Consequently, any study of rating must deal with the accuracy of 
social perceptions. 

Despite the doubts and misgivings of some concerning the 
competency of students to Judge good teaching, researchers rec- 
ognise the contribution students can make by virtue of their role 
as consumers of the educational product. 

A review of the literature indicated that the student's per- 
ception of the role he is Asked to play is a crucial one, but few 
efforts have been made to influence these perceptions in a positive 
direction. 
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II 



The Problem 



The evaluation of teacher behavior is a vital concern of 
educators. Students are asked to play a major role in the rating 
process. Steckleln (1960)clted evidence that forty percent of 
eight hundred and four colleges and universities in the United 
States surveyed have used students' ratings of teachers. 

Despite the fact that effort has been exerted to Increase 
the reliability of ratings through training of the observers in 
the use of the instruments, little is known concerning the 
attitudes of the student toward this role and the extent to which 
the student's attitudes can be Influenced in a positive direction. 

Since students tend to rebel against Involvement in activities 
which they do not fully understand, the problem was that of deter- 
ming the extent to which an orientation treatment would cause a 
positive attitude change in students toward their role as raters 
of teacher behavior. 

111. Objective and Hypotheses 

The objective of the investigation was to develop and test an 
orientation treatment for freshmen college students that would cause 
a positive attitude change toward their role as raters of teacher 
behavior. It was anticipated that this attitude change would be 
reflected in the student's willingness to continue as a rater when 
given the choice to participate as a rater or not to participate. 

Due to the unique and peculiar perceptions of the raters a con- 
siderable variability in ratings was assumed to exist. The orienta- 
tion treatment was designed to reduce this inter-rater variability 
and to develop a more nearly uniform frame of reference for the 
raters. 

The hypotheses tested were: 

1. There is no significant difference in the attitudes 
of students receiving an orientation treatment to 
their role as raters of teacher behavior and the 
attitudes of the control group. 

2. There is no significant difference in the choices of 
students receiving an orientation treatment to con- 
tinue to participate as a rater and the choice of 
the control group. 

3. There is no significant difference in the variance 
of students receiving an orientation treatment and 
the variance of the control group. 
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PART II 



Methods and Procedures 



I . The Sample 

The subjects for this study were drawn from the freshmen 
students enrolling for the first time in the fall of 1969 at 
Freed-Hardeman College. Two equal groups , N»50, were randomly 
selected from the freshman class utilizing a table of random 
numbers. 

Due to attrition over the treatment period, eleven from the 
control group and ten of the experimental group did not complete 
the year' 8 work and consequently did not take the post test. 

II. The Attitude Scale 

An attitude scale concerning the role of students as raters 
of teachers was develooed by the investigator with the assistance 
of Dr. Nairn Sefein, the State University, Fredonia, New York. 

Sixty statements were developed that were designed to elicit 
a response indicating an attitude toward rating. These sixty 
statements were submitted to an Informal rating by three judges. 

Thaee judges categorized the statements as favorable or not favor- 
able to rating of teachers by students. The judges also rated the 
statements relative to ambiguity and clarity. 

Thirty-six items that received unanimous approval by the judges 
were retained. A few items were reworded to change the direction 
of the statement in order to establish a balance between positively 
directed and negatively directed statements. 

A Likert type scale of five categories was used with the thirty- 
six items. The. attitude scale was field tested using college students 
enrolled in classes in social psychology, personality and education. 

In addition, five sophomores selected at random were asked to read 
and critique the scale for clarity. Their comments were helpful in 
the final revision of the statements. 

The attitude scale was developed with the Intent of soliciting 
from students their attitudes toward rating from the following 
standpoints : 

1. Rating as a student responsibility vs. rating as 
a student privilege. 
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2. The usefulness of rating vs. Its uselessness. 

3. Rating as an Important activity vs. rating as 
busy work. 

A copy of the scale is included In this report, Appendix A. 

Students in the control and experimental groups completed the 
scale as a pre test. After the orientation treatment, both groups 
responded to the scale in a post test setting In order to collect 
data for comparison and to determine the effect of the orientation 
treatment. 

In the spring and before the last rating of teachers for the 
academic year, students in both the control and experimental groups 
were given the choice of rating or not rating their teachers. The 
decisions of students in each group were tabulated. 

III. The Treatment 

The orientation treatment was developed and administered to 
the experimental group. Three group counseling sessions were held 
to explain (1) the purposes of rating, (2) the importance of student 
opinion, (3) the efforts being made by the faculty to improve 
Instruction, (4) the use to be made of the data collected, and (5) 
thn poc3ible benefits to students which could occur as a result of 
their participation as raters. 

The first orientation wap given on February 24, 1970 following 
the pre test. An explanation of the schedule for future sessions 
was given. Transparencies and samples of the University of Illinois 
Course Evaluation Questionnaire were used along with the discussion. 

The second and third orientation sessions were held on April /, 
1970 and May 7, 1970. All sessions were held at 10:30 a. a. in one 
of the regular classrooms. The outlines for the three orientation 
sessions are Included as Appendix B. 
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PART III 



Findings and Analysis 



I . Results 

The central thrust of this investigation was to determine the 
attitude of students toward their role as raters and the extent 
to which these attitudes could be changed in a positive direction. 
An attitude scale was developed and used to collect these data. 

Also, a tabulation of student choices to participate or not to 
participate in the final rating for the year was made. 

After the data was collected using the attitude scale it was 
processed by a computer and used to test the following hypotheses: 

A. The first hypothesis was: 

"There is no significant difference in the attitudes of 
students receiving an orientation treatment to their 
role as raters of teacher behavior and the attitudes of 
the control group." 

A comparison of gain scores on students in the experimental 
and control groups was made using a t-test. This data is con- 
tained in TABLE 1. The hypothesis cannot be rejected. The 
orientation treatment did not significantly change the attitudes 
of the experimental group. However, a comparison of pre test and 
post test scores on items for students in the experimental group 
as shown in TABLE 2 shows a significant change on Items 6, 8, 15, 

25 and 32 of the attitude scale. This indicates the conviction of 
the experimental group that good teaching is an art to be developed, 
that student evaluations should be made public to other students 
in the selection of their courses, that rating should be done by 
students of all levels of achievement and that students have no one 
to blame but themselves for their failure. 

A difference scores matrix on items for matched pairs in the 
experimental group and in the control group is shown in TABLE 3. 

The experimental group displayed an increase from pre test to post 
test on nineteen of the items. 

Although the change in the experimental group was not large 
enough to he significant, some positive change did occur within 
the experimental group. 
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TABLE 1 

COMPARISON OF GAIN SCORES 



ON 


STUDENTS IN 


THE EXPERIMENTAL AND 
USING A T-TEST 


CONTROL GROUPS 


Group 


Sample 


Mean gain score 


Standard deviation 


Experimental 


39 


-0.82 


12.61 


Control 


37 


1.61 


8.30 



t ■ -1.08, N => 76, DF « 74 
t prob. < .05 * 1.6882 
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TABLE 2 

COMPARISON OF PRE-TEST AND POST-TEST SCORES 
ON ITEMS FOR STUDENTS IN THE EXPERIMENTAL 
CROUP USING A T-TEST 

DF=87 



Item 


T-value 


Significance 


Item 


T-value 


Significance 


i 


-0.'J2 


MS 


19 


-0.94 


NS 


2 


0.85 


NS 


20 


0.54 


NS 


3 


-1.55 


NS 


21 


1.10 


NS 


4 


-0.17 


NS 


22 


-0.20 


NS 


5 


0.81 


NS 


23 


0.72 


NS 


6 


-2.09 


'.03 


24 


1.28 


NS 


7 


-0.80 


NS 


25 


-1.89 


.05 


8 


2.18 


i 

.05 


26 


-0.15 


NS 


9 


-1.65 


MS 


27 


-0 . 9 1 


NS 


10 


0.71 


r:s j 


28 


1.31 


NS 


11 


-0.16 


i 

NS | 

1 


29 


-0.69 


NS 


12 


1.46 


i 

NS 


30 


-0.46 


NS 


13 


0.76 


:%s ! 


31 


0.19 


NS 


14 


-0.71 


NS 


32 


-2.62 


.01 


15 


-2.19 


.05 


33 


-0.27 


NS 


16 


-0.21 


NS ; 


34 


-0.21 


NS 


17 


-0.99 


NS 


i 35 


0.22 


NS 


18 


0.30 


NS ! 

1 


1 36 

1 


-0.59 


NS 


Levels : 


P < >05 
P < -oi 


t = 1.665 
t = 2.376 
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TABLE 3 

DIFFERENCE SCORES MATRIX ON ITEMS FOR MATCHED 
PAIRS IN THE EXPERIMENTAL GgOUP 
AND IN THE CONTROL GROUP 



Groups 


Groups 


Item 


Experimental 


Control 


Item 


Experimental 


Control 


1 


0 


+ 


3.9 


+ 


0 


2 


- 


0 


20 


- 


+ 


3 


+ 


“ 


21 


- 


- 


4 


+ 


+ 


22 


- 


+ 


5 


0 


+ 


23 


- 


•f 


6 


+ 




24 


- 


- 


7 


+ 


- 


25 


+ 


+ 


8 


- 




26 


- 


- 


9 


+ 


+ 


27 


+ 


- 


10 


- 


- 


28 


- 


- 


11 


+ 


- 


29 


+ 


+ 


12 


- 


- 


30 


+ 


0 


13 


- 


- 


31 


+ 


+ 


14 


+ 


- 


32 


+ 


0 


15 


+ 


+ 


33 


- 


- 


16 


- 


0 


34 


+ 


+ 


17 


+ 


- 


35 


- 


- 


18 


+ 


- 


36 


+ 


- 








Average 


+ 


- 



^Difference scores were formed by subtracting pre-test 
mean rankings from post-teat rankings on the Instrument. 
The +*8, -"8, and 0’s recorded indicate increase, 
decrease, or no change from pre-test to post-test. 
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B. The second hypothesis was: 

"There is no significant difference in the choices of 
students receiving an orientation treatment to continue 
to participate as 3 rater and the choices of the con- 
trol group. 11 

A comparison of choices to rate with the experimental and 
control groups was made using a chi-square test of significance. 

The data is presented in TABLE 4. The decision to keep on as a 
rater was independent of the subject f s group and the hypothesis 
could not be rejected. However, the choice of the control group 
was so predominantly in favor of continuing to participate as a 
rater that there was very little possibility for a significant 
difference to occur between the experimental and control groups. 

C. The third hypothesis was: 

"There is no significant difference in the variance of 
students receiving an orientation treatment and the 
variance of the control group. 11 

A comparison of pre test and post test variance for experimental 
and control groups was made using an "F" ratio test of significance. 
This data is contained in TABLE 5. There was no significant dif- 
ference between the variances of the experimental and control groups, 
therefore the hypothesis cannot be rejected. The treatment was not 
effective in causing a reduction in inter-rater variability. 

II . Conclusions 

The treatment was not effective in causing a significant attitude 
change in a positive direct!: * in the experimental group as compared 
with the control group. A difference scores matrix did Indicate 
some positive change within the experimental group. 

The control group was affectively disposed toward continuing 
as raters. This is a desirable condition, and could be an explana- 
tion for the lack of significant difference in the choice of rating 
between the experimental and control groups. 

The variance within both experimental and control groups was 
low. The treatment did not cause a significant reduction in inter- 
rater variability. 

From a research standpoint, the treatment failed to produce a 
positive attitude change. The questionnaire did reveal the fact 
that students in both experimental and control groups recognize the 
importance of the role they play as raters of instruction and are 
willing to continue to rate teachers. 
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TABLE 4 

COMPARISON OF CHOICES TO RATE 
WITH EXPERIMENTAL AND CONTROL GROUPS 
USING CHI-SQUARE ANALYSIS 

N ■ 77 



Choice of Rater 


Experimental 


Group 

Control 


Total 


Yes 


38 


32 


70 


No 


J 2 


_5 


_7 




40 


37 


77 


X 2 - .813 








Level P <. .05 


X 2 = 3.841 


df = 1 
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TABLE 5 

COMPARISON OF PRE-TEST AND POS1-TEST 
VARIANCE FOR EXPERIMENTAL AND CONTROL GROUPS 
USING AN "F" RATIO TEST 



Group 


DF 


F-value 


Significance 


Experimental 


87 


1.20 


NS* 


Control 


87 


1.14 


NS* 



Level * P < .05 
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III. Recommendatio ns 

The role that students are asked to play as raters of teachers 
is tremendously important. Efforts should be made to continue the 
orientation of students to that role. 

A replication of this study might be made on another campus 
with a differently oriented student body, where greater variability 
exists, and where students are less disposed to rating. 
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APPENDIX A 



Freed- Hardeman College 
Henderson, Tennessee 

Student Attitudes Toward Rating of Instructors 



Directions i 

This is not a test. It is only a survey of opinions. 
Ihere are no right or wrong answers. You are not asked 
to write your name and the information you provide will 
be used for research purposes only. Please give your frank 
and honest opinion. 

The questionnaire consists of two parts. The first 
part solicits your opinion regarding some school matters. 
You are requested to express your own opinion as accurately 
as you can. Give a response to every item. Some items 
may be hard to respond to. Do the best you can but do 
respond. Make each response on the appropriate space on 
the answer sheet. 

The second part of the questionnaire solicits some 
general information about yourself. Please answer all 
the questions as accurately as you can, by making a 
check mark in the space to the left of the appropriate 
response . 

Remember, this is not a test. The information you 
provide will be used in research only. 

Thank you for your cooperation. 



B. J. Naylor 



Port I 



Road oaoh of tho following atatomonts and blaokon tho 

0 which corresponds to your opinion (SA*= Strongly Agrooj 

A* Agrooj U® Undooidod; D^ DisQgroojand SD= Strongly Disagroo) 

1. A toaohor is raroly intorostod in what students think 

about his instruction *..*. 

2. Students who roally want to loarn should sook holp from 

tho instructor as soon as thoy oncountor difficulty in 
tho course 

3. Requiring tho rating of a teacher by his studonts forooa 
tho toaohor to bo sonsitivo to tho noods of tho studonts. 

If* Asking studonts to rate toachors is a gimmiok usod to 

givo studonts tho impression that toaohors caro about tho 
studonts • noods and opinions 

5* Studonts do not know enough about touching to givo 

meaningful ovaluations of their toachors 

6. A toaohor is likoly to tako his job moro seriously whon 
ho knows that studonts will rate him 

7* Good toaching oan bo achiovod only by employing good 
toachors. 

8* Student oxpootations vary in suoh a way that a toaohor 
could novor bo ablo to satisfy all 

9* Good toachors aro bornj studont ratings cannot chango 

thoso who do not havo a natural ability to toaoh 

10. Toachors aro too busy with affairs othor than thoir 

toaching to bo ablo to do a good job of toaching 

11. Studonts rato a toachor moro in terms of thoir opinion 

of tho content of tho courso than in torms of thoir 
opinion of tho teacher's instructional procedure* 

13. Schools aro created for studonts- and toaohors should 

toach what studonts nood 

13 * 5ho collogo administration should tako studont ratings 
of instructors into consideration whon deciding on 
toaohor promotions 

14. Studont rating of toaohors is ono of tho boat ways of 
communicating to toachors tho foolings of thoir studonts* 

1$. Toaohor ovaluations raado by studonts should bo mado 

public to permit othor studonts to soloct thoir coursos 
judiciously * 

16. Studonts should regard thoir rating of toachors as a 

serious responsibility 
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SA 


A 


0 


D 


SD 


0 


0 


0 


0 
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SD 
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0 
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0 


0 


0 


0 


0 


SA 


A 
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D 


SD 


0 


0 


0 


0 


0 
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17 • Evory studont should participate in rating his 

instructors 

Id. Toachors aro burdonod with many domands that tako thoir 
intorost away from touching. • . . . 

19* Tho responsibility for evaluating toachors bolongs to tho 
collogo administration, not to tho studonts 

20. It is tho responsibility of ovory studont to oxpross his 
opinion rogarding tho quality of instruction ho rocoivos* 

21. Abovo all olso, toaohors should bo ratod on thoir concorn 

for studonts 



22* Most studonts do not toko ratings of toaohors soriously. 

23. Rating toaohors will likoly rosult in roduoing aoadomio 
standards booauso toaohors will sook studont approval by 
boing loniont'. 

24* Studonts must lot tho toaohor know whon ho is not toaoh- 
ing in suoh a way that thoy undorstand, ovon though thoy 
aro unablo to offor suggestions to corroot tho situation 

25 . Rating toaohors is a sorious job that must to dono only 
by studonts of abovo avorago intolligonoo and aoadomio 
ability 

26* A good toaohor sonsos what studonts fool about him 

without a rating soalo. 

27 • Teachers aro not vory intorostod in studonts thoso days, 

28. Toachors usually do tho bast thoy can with tho rosouroos 
thoy havo 

2V* Studont rating of instructors is an offootivo mothod for 
improving tho quality of instruction 

3<). Studonts must sharo tho blamo with tho toaohor for 

faulty instruction. • • 

31 • Toaohors aro only obllgatod to bolp thoso studonts who 
aro sinooro in sooking holp 

32. Studonts havo no cno to blamo but thomsolvos for thoir 
failuro to learn 

33* Toaohors who ask for ratings aro usually 9ooking 

oonpllmonts rathor than tho truth 

34 • Toaohors aro victims of tho gonoral studont disoontont 
that is swooping tho schools of tho nation thoso days. . 

35, In kooping with tho spirit of domooraoy t studonts should 
havo a say concornirg tho kind of touching thoy aro to 
rocoi vo« 



36. 



o 



Tho idoa of rating toachors implios that toaohors aro not 
doing thoir bost. 
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APPENDIX B 



Orientation Treatment 
Session One 
February 24, 1970 



I. Introduction 

A. Explanation of the Orientation sessions 

B. Topics to be discussed 

1. The purposes of rating - 

2. The importance of stuaent opinions. 

3. The efforts being nade by the faculty to improve 
instruction. 

4. The use to be made of the data collected. 

5. Ihe possible benefits to students which could occur as 
a result of their participation as raters. 

II. The Purposes of Rating 

A. As a means of helping the instructor spot areas of strength 
end weakness as seen through the eyes of the learner. 

1. Show transparency of the University of Illinois printout 
for a typical teacher . 

a. Identify areas of strength. 

b. Identify areas of weakness. 

2. Cive students a copy of the Stanford and Purdue rating 
scales. Using transparencies, show how results are 
returned to the instructor. 

a. Transparency one' -scene depicting a lew rating on 

"Organisation of Lesson". 

b. Transparency two — --scene depicting a high rating on 

"Clarity of Aims". 

c. Transparency three— scene showing two teachers compar- 

ing results of student ratings. 
"Comparison of Results of Student 
Ratings". 
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3. Emphasize to students that ratings of teachers should be 
made on the basis of instructional procedures rather 
than on interest of the course. 

a. Some courses have content high in Interest. 

b. Some courses have content low in interest. 

B. As a stimulus to an instructor to continuously assess his 
reaching procedures and techniques. 

1. Students come to the classroom from an "all-at-once" 
electronic age. They are likely to become impatient 
with approaches used 30 years ago, (Transparency 
four-— scene showing an old-timer who has been lecturing 
for thirty years and refuses to change. "Change in 
Methodology") 

2. As the instructor receives a print-out each semester 
with ratings on items related to his instruction, his 
attention is directed to those Areas of instruction 
which otherwise might be ignored, 

C. To cause the instructor to become more sensitive to the needs 
of the learner . 

1. The ratingo draw attention to the pacing of the lesson. 

2. Attending behavior should cause the instructor to become 
more cognizant of individual r‘>lllties and needs. 
(Transparency five — scene she \g an instructor who is 
unaware of individual needs. "Recognition of Individual 
Needs") 

3. Hopefully, ratings will help the Instructor become more 
sympathetic to the needs of the learner. 

D. As a means of gathering data that is more specific and 
objective than relying on opinion and general feelings of 
successful teaching. 

1. A subjective basis for decision making can be misleading 
(Transparency six— —scene showing the instructor who relies 
on general feeling as indicator of success. "Indicia of 
Success") 

2. Specific needs are illuminated when they are singled out 
for consideration. 
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3. Over-all improvement comes about by improvement in 
specific areas. 

E. To demonstrate to students the concern that instructors 
have for them as learners. 

1. The decision of the instructor to use student ratings 
is evidence of concern for the student. 

2. Assurance is given to the student that the instructor 
desires feedback from the student. (Transparency 
seven — scene showing the instructor asking for learner 
reaction. "Student Feedback") 



Orientation Treatment 
Session Two 
April 7, 1970 



I. Introduction 

Throughout the United States college scudents are demanding a 
greater voice In those activities that affect them. When 
opportunities to participate In decision-making are not provided, 
students devise means of drcwlng attention to their grievances. 

Rating of teachers provides an orderly and constructive way 
of allowing students to participate and glvns them a legitimate 
channel for the expression of opinions. 

Students are regarded as paying consumers of our product with 
the Inherent right to ovaluate and make recommendations concerning 
the instruction they receive. 

In spite of some unfortunate aspects of attempts at student 
rating of teachers, no one should suppose that the opinion of 
students concerning the teaching they receive Is without signifi- 
cance. There Is evidence by Bryan (1937), Leeds (1950), Starrock 
(1934) and Reusers (1963) to Indicate that students are honest and 
reliable raters of teachers and that they can furnish valuable 
Information even though they are not experts on teaching. 

II. The Importance of Student Opinions 

A. All persons Involved In the learning process should have an 
opportunity to express themselves by evaluating those events 
that affect them. 

B. Students at various levels of achievement should be given an 
opportunity to rate In order to get a cross-section of student 
views, 

Woodbum (1966) reported on a study conducted at the 
University of Michigan concerning the validity of ratings by 
students with various academic achievement levels. He found 
the rating of teaching effectiveness by "D" and "E" students 
to be substantially the same as that of the "A" and "B" 
students about a particular Instructor. 

C. Students can supply information that Is not available from other 
sources. Students are the only group who sea their teachers per- 
form In the classroom day after day. They can furnish valuable 
Information that can be used to Improve Instruction and 
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provide a mirror that teachers may use to see themselves as 
others see them. 

Significant Information that only students can provide Is: 

1. Whether information aimed at them Is getting 
acorss, or not. 

2. Whether the Instructor Is confusing them or not. 

3. Whether the te>t questions and grading system are 
reasonable and fair or not. 

4. The quality of the presentations made In class 
by the teacher. 

D. Since rating scales are anonymous students can communicate 
thel- evaluation to teachers without fear of reprisal. 

E. Since student opinions are Important, students have a 
responsibility to share their perceptions of Instruction 
with the teacher. Teacher evaluation must be conceived as 
a process of appraisal where all elements that constitute a 
part of the teaching-learning process are given appropriate 
and fair consideration Teaching and learning require In- 
teraction between student and teacher. The rating process 
provides feedback and Is a contribution by the student to 
Improved teacher effectiveness. 
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Orientation Treatment 
Session Three 
May 7, 1970 



I. Introduction 

A. Review purposes of rating 

1. As a means of helping the instructor spot areas of 
strength and weakness. 

2. As a stimulus to an instructor to continuously assess 
his teaching procedures and techniques. 

3. To cause the instructor to become more sensitive to the 
needs of the learner. 

4. As a means of gathering data that is more specific and 
objective than relying on opinions and general feelings 
of successful teaching, 

5. To demonstrate to students the concern that instructors 
have for them as learners. 

B. Review the importance of student opinions 

1. Students can supply information that is not available 
from other sources. 

2 . Students at various levels of achievement should be given 
an opportunity to rate in order to get a cross-section of 
student views. 

3. All persons involved in the learning process should have 
an opportunity to express themselves by evaluating those 
events thav affect them. 

4. Students have a responsibility to share their perceptions 
of Instruction with the teacher. 

5. Ratings are anonymous and students can communicate their 
evaluation to teachers without fear of reprisal. 

11. Efforts Being Made by Our Faculty to Improve Instruction 

A, Per cent of the faculty who have used the University of Illinois 

Course Evaluation Questionnaire. 
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H. Explain the visiting scholars program with Peabody College 
which is a means of sharing information that is designed to 
improve instruction. 

C. Participation over a period of three years by eight faculty 
members in the West Tennessee P.esearcli Consortium program. 

D. Faculty members who are involved in graduate study. 

E. Hie program of audio-visual orientation that is available to 
the faculty and the extent of the participation. 

III. The Use to be Made of Data Collected from Ratings 

A. As a means of spotting strengths and weaknesses. 

B. Results are sent to the teacher and department chairman. 

The teacher is encouraged to engage in self-evaluation. 

C. Hie teacher has available the assistance of the Director of 
Testing in interpreting the results of rating and supplying 
suggestions that could be used in improving areas of weakness. 

D. The ratings could serve as the basis for study groups. Teachers 
could meet together after receiving their ratings and discuss 
ways to improve instruction. 

E. Student groups on some campuses collect the ratings and make 
them available to students who are contemplating enrollment 
in one of the Instructor's classes. 

IV. Possible Benefits to Students as a Result of Rating 

A. Improved instruction. 

B. Greater sensitivity to student needs. 

C. Help students develop an awareness of the changing practices 
in education. 

D. To help students moderate their expectations of teachers and 
not become discouraged when change comes slowly. 

V . Summary 

A. Review the three orientation sessions. 

B. Invite comments and questions. 
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